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DETAILED ACTION 

Claim Rejections - 35 USC § 103 

The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

Claims 1-29 are rejected under 35 U.S.C. 103(a) as being unpatentable over "Microsoft 
Windows NetMeeting 3", http://wvvw.microsoft.com/windows/NetMeeting/Features/default.asp, 
hereinafter NetMeeting, and Schilit et al (US Patent 6,687,876), hereinafter Schilit. 

Regarding claims 1 and 20, NetMeeting teaches receiving, in a first client, an 
identification of a second client to initiate a chat session with, initializing a chat session across a 
network between the first client and the second client, displaying a graphical image on the first 
client (all taught as part of the video and audio conferencing capabilities of NetMeeting, on page 
2 and the chat feature of page 3), selecting a command to markup the graphical image (taught 
as the use of selectable drawing tools on a shared Whiteboard, on page 4), and transmitting the 
markup file across the network to the second client through the chat session (inherent to the 
program to allow users at different workstations to view edits to the graphical images). 
Furthermore, NetMeeting teaches markup entities that specify a type of markup to be displayed, 
taught as the use of a graphic editing toolbar (see the left side of the Whiteboard image) similar 
to that used by Microsoft Paint. The toolbar clearly allows for different markup entities, such as 
freeform drawings, text, and geometric objects. 

NetMeeting does not explicitly teach in response to the command, storing markup 
information in a markup file separate from the graphical image, a source reference that identifies 
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the graphical image, and an orientation that indicates how the graphical image should be 
displayed with regard to the markup entity. 

Schilit teaches a method for maintaining freeform ink annotations similar to those found 
in NetMeeting. Furthermore, Schilit teaches the separation of annotations from the original 
display (the annotation database of col. 14, lines 4-8), which are inherently related to an 
identified source image, and an orientation that indicates how the graphical image should be 
displayed with regard to the markup entity (taught as the relation of stored annotation strokes 
and anchor points to their relevant locations on a document, at col. 14, lines 8-49). 

Therefore, it would have been obvious to one of ordinary skill in the art, having the 
teachings of NetMeeting and Schilit before him at the time the invention was made to modify the 
markup chat sessions of NetMeeting to include the separation of an original source image with 
its annotations in order to obtain a chat markup system where annotations are stored separately 
from their source images. 

One would be motivated to make such a combination for the advantage of maintaining 
the integrity of an original image to be annotated through the use of a transparent markup 
image, or the possibility of having more than one markup file related to a given image, instead of 
multiple copies of an original image with annotations, thus conserving storage space. 

Regarding claims 2 and 21, NetMeeting teaches storing the graphical image local to the 
second client, taught as the ability of NetMeeting users to save Whiteboard contents, at page 4. 

Regarding claims 3 and 22, it can be seen in the NetMeeting image of page 4 that image 
markup commands are selectable from a graphic editing menu, and that multiple markup 
entities are available to markup the graphical image. 
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Regarding claims 4 and 23, NetMeeting allows for a markup entity to be a second 
graphical image, taught as the ability to cut, copy, and paste information from any Windows- 
based application into the Whiteboard, at page 4. 

Regarding claims 5 and 24, it can be seen in the NetMeeting image of page 4 that the 
markup entity may contain text. 

Regarding claims 6 and 25, NetMeeting and Schilit do not explicitly teach the use of 
XML for conveying markup information, including a markup entity tag, a source reference tag, 
and an orientation tag. However, XML files are well known in the art to give a user the flexibility 
of tag customization for specific information. The Examiner takes OFFICIAL NOTICE of this 
teaching. Therefore, it would have been obvious to one of ordinary skill in the art to include an 
XML file for storing markup information for the advantage of the flexibility offered by the 
language. Furthermore, any file used to store the annotations of NetMeeting and Schilit 
separately from the source image itself would inherently contain information pertaining to the 
markup entities used, the source reference to which the markup entities pertain, and the 
orientation for the annotations. As XML uses specific tags that enable the formatting of related 
documents, it would have been obvious for a user to create XML tags specific to the markup 
entities, source reference, and orientation of the annotations in a separate XML annotation file. 
See "What is XML?" by Norman Walsh, at http://www.xml.eom/pub/a/98/10/guidelhtml#AEN78. 

Regarding claims 7, 8, 26 and 27, it can be seen at NetMeeting page 3 that a single user 
or multiple users may be specified as the second client in contact with a first client. 



Application/Control Number: 09/916,391 
Art Unit: 2173 



Page 5 



Regarding claims 9 and 28, applicant's specification points to XML or other document 
definition languages as being "firewall friendly" and therefore provide for the transmission of a 
markup file and text across a network without breaching firewall security measures. Markup 
information in XML is taught supra, and thus provides for the transmission of a markup file and 
text across a network without breaching firewall security measures. 

Regarding claims 10 and 29, the chat feature of NetMeeting (page 3) discloses 
functionality similar to an instant messaging application, such as the selection of a user or users 
to send messages to, and the ability to send private messages. 

Regarding claim 11, NetMeeting inherently teaches a first client computer and a display 
device connected to the first client computer. Furthermore, any modern-day computer with 
storage means is capable of storing a graphical image. NetMeeting shows an instant 
messaging application installed on a first client computer (the chat capabilities of page 3) and 
allows for a selectable command to markup a graphical image (the Whiteboard of page 4). 
Through the use of such chat and Whiteboard capabilities, NetMeeting allows for receiving an 
identification of a second client to receive the markup file, initializing a chat session across a 
network with the second client, transmitting the markup file across the network to the second 
client through the chat session, and displaying the markup entity in the orientation on the 
graphical image on the display device. Furthermore, NetMeeting teaches markup entities that 
specify a type of markup to be displayed, taught as the use of a graphic editing toolbar (see the 
left side of the Whiteboard image) similar to that used by Microsoft Paint. The toolbar clearly 
allows for different markup entities, such as freeform drawings, text, and geometric objects. 
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NetMeeting fails to explicitly teach in response to the command, storing markup 
information in a markup file stored separately from the graphical image, a source reference that 
identifies the graphical image, and an orientation that indicates how the graphical image should 
be displayed with regard to the markup entity. 

Schilit teaches a method for maintaining freeform ink annotations similar to those found 
in NetMeeting. Furthermore, Schilit teaches the separation of annotations from the original 
display (the annotation database of col. 14, lines 4-8), which are inherently related to an 
identified source image, and an orientation that indicates how the graphical image should be 
displayed with regard to the markup entity (taught as the relation of stored annotation strokes 
and anchor points to their relevant locations on a document, at col. 14, lines 8-49). 

Therefore, it would have been obvious to one of ordinary skill in the art, having the 
teachings of NetMeeting and Schilit before him at the time the invention was made to modify the 
markup chat sessions of NetMeeting to include the separation of an original source image with 
its annotations in order to obtain a chat markup system where annotations are stored separately 
from their source images. 

One would be motivated to make such a combination for the advantage of maintaining 
the integrity of an original image to be annotated through the use of a transparent markup 
image, or the possibility of having more than one markup file related to a given image, instead of 
multiple copies of an original image with annotations, thus conserving storage space. 

Regarding claim 12, NetMeeting shows the instant messaging application configured to 
display the markup file in the orientation on the graphical image on the display device in 
response to receiving the markup file during the chat session, shown as the use of the 
Whiteboard application between multiple participants, at page 4. 
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Regarding claim 13, it can be seen in the NetMeeting image of page 4 that image 
markup commands are selectable from a graphic editing menu, and that multiple markup 
entities are available to markup the graphical image. 

Regarding claim 14, NetMeeting allows for a markup entity to be a second graphical 
image, taught as the ability to cut, copy, and paste information from any Windows-based 
application into the Whiteboard, at page 4. 

Regarding claim 15, it can be seen in the NetMeeting image of page 4 that the markup 
entity may contain text. 

Regarding claim 16, NetMeeting and Schilit do not explicitly teach the use of XML for 
conveying markup information, including a markup entity tag, a source reference tag, and an 
orientation tag. However, XML files are well known in the art to give a user the flexibility of tag 
customization for specific information. The Examiner takes OFFICIAL NOTICE of this teaching. 
Therefore, it would have been obvious to one of ordinary skill in the art to include an XML file for 
storing markup information for the advantage of the flexibility offered by the language. 
Furthermore, any file used to store the annotations of NetMeeting and Schilit separately from 
the source image itself would inherently contain information pertaining to the markup entities 
used, the source reference to which the markup entities pertain, and the orientation for the 
annotations. As XML uses specific tags that enable the formatting of related documents, it 
would have been obvious for a user to create XML tags specific to the markup entities, source 
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reference, and orientation of the annotations in a separate XML annotation file. See 'What is 
XML?" by Norman Walsh, at http://www.xmI.eom/pub/a/98/10/guide1.html#AEN78. 

Regarding claims 17 and 18, it can be seen at NetMeeting page 3 that a single user or 
multiple users may be specified as the second client in contact with a first client. 

Regarding claim 19, applicant's specification points to XML or other document definition 
languages as being "firewall friendly" and therefore provide for the transmission of a markup file 
and text across a network without breaching firewall security measures. Markup information in 
XML is taught supra, and thus provides for the transmission of a markup file and text across a 
network without breaching firewall security measures. 

Response to Arguments 

Applicant's arguments filed 28 December 2005 have been fully considered but they are 
not persuasive. 

In response to Applicant's argument of page 10, that neither NetMeeting nor Schilit 
teach the storage of a markup information in a markup file separate from the graphical image in 
a chat session environment and that neither suggest the combination of the chat session on a 
network with the markup techniques and file separation, the Examiner respectfully disagrees. 
As stated above, the NetMeeting reference teaches the ability to markup a graphical image by 
way of the Whiteboard, and further teaches chat session capabilities. Schilit is relied upon for 
the separation of the base image file with that of the freeform markup entities, and does so by 
way of storing the perceived strokes in a database. Therefore, a combination of NetMeeting 
and Schilit would produce a media conferencing application capable of chat sessions and 
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freeform graphical image markup, wherein the strokes for such markup are in a file separate 
from the base graphical image. 

Applicant further argues that there would be no motivation to combine NetMeeting and 
Schilit, and even if combined, such a combination would fail to teach the invention as claimed. 
The Examiner respectfully disagrees. Motivation for such a combination is shown supra. 
Furthermore, Applicant argues the inclusion of Schilit teaches away from the claimed elements, 
specifically that as Schilit uses a database for storage of stroke information, such a combination 
would lead to slow transmission times and multiple steps on behalf of the user. The Examiner 
notes that while it is a goal of the specification to reduce transmission time and simplify user 
interaction, such language is not found in the claims. The claimed limitations only necessitate 
the transmission of the markup file across a network, which is certainly possible with a 
combination of NetMeeting and Schilit. 

In response to Applicant's arguments with respect to claims 6, 16, and 25, as stated 
above, any file used to store the annotations of NetMeeting and Schilit separately from the 
source image itself would inherently contain information pertaining to the markup entities used, 
the source reference to which the markup entities pertain, and the orientation for the 
annotations. As XML uses specific tags that enable the formatting of related documents, it 
would have been obvious for a user to create XML tags specific to the markup entities, source 
reference, and orientation of the annotations in a separate XML annotation file. 

The Examiner would further like to note that XML is widely used in the database art, and 
the creation of a simple XML database containing information pertinent to any markup entities is 
highly plausible and certainly possible at the time the invention was made. 



Conclusion 
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THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing date 
of this final action. 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Michael Roswell whose telephone number is (571) 272-4055. The 
examiner can normally be reached on 8:30 - 6:00 M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Cabeca can be reached on (571) 272-4048. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

Michael Roswell 




